﻿ Tehnicide IngineriaLimbajului Natural Curs 5 Tehnologiiletextului Nivelulsemantic: Anafora-fenomeneanaforice șirezoluțiaanaforei Curs: Dan Cristea Laboratoare: Diana Trandabăț, Mihaela Onofrei, Daniela Gîfu, Ionuț Pistol Overview •Anaphoric phenomena •RARE –a framework for general anaphora resolution This course is based on the article: Cristea,D ; Postolache,O D (2005): How to deal with wicked anaphora, in António Branco, Tony McEnery and Ruslan Mitkov (editors): Anaphora Processing: Linguistic, Cognitive and Computational Modelling, Series IV –Current Issues in Linguistic Theory, vol 263, Benjamin Publishing Books, Amsterdam/Philadelphia, pp 17-46 For an online access, follow this link: https://profs info uaic ro/~dcristea/papers/CristeaPostolache %20-%20WickedAnaphora pdf 2 Anaphoric phenomena 3 Anaphoraand coreference •Two lexical strings are anaphoricif the mental processing of the second (anaphor) depends on the mental processing of the first (antecedent) I’m right now beginning a talkon AR The audienceseems to be still happy •Two lexical strings corefer is they mean the same thing (entity) John met Maria for the first time when he was a student 4 Anaphora eq coreference? •Not all anaphoric links are coreferences: The carstopped John tried to fix the motor •Not all coreferences are anaphoric: The sunis shining today… I begun to read a book about Amenomphis the IVth, the Egyptian pharaoh, son of the sun 5 What are coreference chains? Winstonwas just taking hisplace in one of the middle rows when two peoplewhom heknew by sight, but had never spoken to, came unexpectedly into the room One of themwas a girlwhom heoften passed in the corridors Hedid not know hername, but he knew that sheworked in the Fiction Department 6 What are coreference chains? Winstonwas just taking hisplace in one of the middle rows when two peoplewhom heknew by sight, but had never spoken to, came unexpectedly into the room One of themwas a girlwhom heoften passed in the corridors Hedid not know hername, but he knew that sheworked in the Fiction Department 7 What are coreference chains? Winstonwas just taking hisplace in one of the middle rows when two peoplewhom heknew by sight, but had never spoken to, came unexpectedly into the room One of themwas a girlwhom heoften passed in the corridors Hedid not know hername, but he knew that sheworked in the Fiction Department 8 What are coreference chains? WinstonwasWinstonwasWinstonwas justjustjust takingtakingtaking hisplacehisplacehisplace ininin oneoneone ofofof thethethe middlemiddlemiddle rowsrowsrows whenwhenwhen twotwotwo peoplewhompeoplewhompeoplewhom heknewheknewheknew bybyby sight,sight,sight, butbutbut hadhadhad nevernevernever spokenspokenspoken to,to,to, camecamecame unexpectedlyunexpectedlyunexpectedly intointointo thethethe room room room OneOneOne ofofof themwasthemwasthemwas aaa girlwhomgirlwhomgirlwhom heoftenheoftenheoften passedpassedpassed ininin the corridors corridors corridors HedidHedidHedid notnotnot knowknowknow hername,hername,hername, butbutbut hethehethehe knew thatthatthat sheworkedsheworkedsheworked ininin thethethe FictionFictionFiction DepartmentknewDepartment knewDepartment 9 Why is resolution easy? •gender concord rules in Romance languages Fr camion=ilvoiture= elle Un camion a tamponné une voiture Ellea été complètement détruite •number concord rules The defence layersapproached the judge Theyask himthe permission to bring in another witness •semantic features The elephanthit the carwith the tromp The windowwas broken part-ofpart-of 10 Why is resolution difficult? •gender mismatch:resolution by semantic features Es Su Majestad suprema… , else mostro’muy emocionado •number mismatch: the government… the ministers… •pronouns –poor semantic features he[+animate, +person, +male, +singular] she[+animate, +person, +female, +singular] it[-animate, +singular] they[+plural] 11 Why is resolution difficult: when to do it? PoliceofficerDavidCheshirewenttoDillard'shome Puttinghisearnextto Dillard'shead,Cheshireheardthemusicalso CheshireDillardhisDillard ? 12 Why is resolution difficult: when to do it? PoliceofficerDavidCheshirewenttoDillard'shome Puttinghisearnextto Dillard'shead,Cheshireheardthemusicalso CheshireDillardhisDillardCheshire 13 Why is resolution difficult: cataphora “FromthecornerofthedivanofPersian saddle/bagsonwhichhewaslying,smoking, aswashiscustom,innumerablecigarettes, LordHenryWottoncouldjustcatchthe gleamofthehoney-sweetandhoney- colouredblossomsofalaburnum…” (O Wilde–ThePictureofDorianGray) 14 RARE: a Robust Anaphora Resolution Engine text RAREAR-model1 AR-model2 AR-model3 anaphoric links 15RARE = two main principles 1 The referential relations are of a semantic nature,not textual (at least Halliday&Hassan) Co-referential anaphoric relation text layer…………………………………………………………… ab aproposes centerabevokes centera cognitive layer………………………………………………………centera 16RARE = two main principles 2 Processing is incremental text layer…………………………………………………………………ba aprojects fsREbprojects fsbRE a projection layer……………………………………………………… fsbfsa fsaproposescenterafsbevokes centera cognitive layer…………………………………… centera 17 An integrated approach to both anaphora… Johnsoldhisbicycle althoughBillwouldhavewantedit text layer …………………………………………………………………ithisbicycle projectsprojects = sg projection layer …………………………………………………nono = sg sem=bicycle det = yessem=¬human evokesproposes no = sg cognitive layer ……………………………sem=bicycle det = yes 18 … and cataphora AlthoughBillwouldhavewantedit, Johnsoldhisbicycletosomebodyelse text layer …………………………………………………………………ithisbicycle projectsprojects projection layer …………………………………………………no = sgno = sg sem=¬humansem=bicycle det = yes proposes evokes cognitive layer ……………………………no = = sgsgno sem=¬humansem=bicycle det = yes 19 No difference between anaphora and cataphora in discourse processing •Introductionofanempty/representation- poordiscourseentity •Additionofnewfeaturesasdiscourse unfolds •PronounanticipationinRomanian En I taught Gabriel to read = Ro L-am învăţat pe Gabrielsăcitească HimÆtaught Gabrielto read 20 Terminology text layer ……………………… …………………………………………REaREbREcREdREx projection layer ………………………………………………PSx DE1 cognitive layer ………………………………………DEmDEj reference expressions 21 Terminology text layer ……………………… …………………………………………REaREbREcREdREx projection layer ………………………………………………PSx DE1 cognitive layer ………………………………………DEmDEj projected structures 22 Terminology text layer ……………………… …………………………………………REaREbREcREdREx projection layer ………………………………………………PSx DE1 cognitive layer ………………………………………DEmDEj discourse entities 23 What is a RARE model? text layer ……………………… …………………………………………REaREbREcREdREx knowledge sources projection layer ………………………………………………PSxprimary attributes DE1 cognitive layer ………………………………………DEmDEj heuristics/rules domain of referential accessibility 24Component 1: the set of primary attributes a morphological -number -lexicalgender -person 25Component 1: the set of primary attributes b syntactic -fullsyntacticdescriptionofREsasconstituentsofa syntactictree[LappinandLeass,1994] CTbasedapproaches[Grosz,JoshiandWeinstein,1995], [Brennan,FriedmanandPollard,1987],syntacticdomainbased approaches[Chomsky,1981],[Reinhart,1981],[Gordonand Hendricks,1998],[KennedyandBoguraev,1996] -qualityofbeingadjunct,embeddedorcomplementofa preposition [KennedyandBoguraev,1996] -inclusionornotinanexistentialconstruction [KennedyandBoguraev,1996] -syntacticpatternsinwhichtheREisinvolved syntacticparallelism[KennedyandBoguraev,1996],[Mitkov, 1997] 26Component 1: the set of primary attributes c semanticandlexical -positionoftheheadoftheREinaconceptualhierarchy, animacy,sex(ornaturalgender),concreteness WordNetbasedmodels[Poesio,VieiraandTeufel,1997] -inclusioninasynonymyclass -semanticroles,outofwhichselectionalrestrictions, inferentiallinks,pragmaticlimitations,semanticparallelism andobjectpreferencecanbeverified 27Component 1: the set of primary attributes d positional -offsetofthefirsttokenoftheREinthetext [KennedyandBoguraev,1996] -inclusioninanutterance,sentenceorclause,consideredasa discourseunit [Hobbs,1987],Azzam,HumphreysandGaizauskas,1998], [Cristeaetal ,2000] 28Component 1: the set of primary attributes e surfacerealisation(type) -thedomainofthisfeaturecontains:zero-pronoun,clitic pronoun,fullpronoun,reflexivepronoun,possessive pronoun,demonstrativepronoun,reciprocalpronoun, expletive“it”,barenoun(undeterminedNP),indefinite determinedNP,definitedeterminedNP,propernoun (name) [GordonandHendricks,1998],[Cristeaet al,2000] 29Component 1: the set of primary attributes f other -inclusionornotoftheREinaspecificlexicalfield(“domain concept”) [Mitkov,1997] -frequencyoftheterminthetext [Mitkov,1997] -occurrenceoftheterminaheading [Mitkov,1997] 30Component 2: a set of knowledge sources •Aknowledgesource:a(virtual)processorabletofetch valuestoattributesontheprojectionslayer [Kennedy and Boguraev, 1996]: a marker of syntactic function and a set of patterns torecognises the expletive “it”(near specific sets of verbs or as subject of adjectives with clausal complements) [Azzam, Humphreys and Gaizauskas, 1998]: a syntactic analyser, a semantic analyser, and an elementary events finder [Gordon and Hendrick, 1998]: a surface realisation identifier and a syntactic parser [Hobbs, 1978]: a syntactic analyser, a surface realisation identifier and a set of axioms to determine semantic roles and relations of lexical items •Minimumset:POS-tagger+shallowparser 31Component 3: a set of matching heuristics or rules •CertifyingRules (applied first):certify without ambiguity a possible candidate •Demolishing Rules (applied afterwards):rule out a possible candidate •Scored Rules: increase/decrease a resolution scoreassociated with a pair 32Component 3: a set of matching heuristics or rules •[KennedyandBoguraev,1996]:apronouncannotco-refer aconstituent(NP)whichcontainsit(thechildofhis brother,hisisneitherchild,norbrother) Theremaining candidatesaresortedbyweighingasetofattribute-values pairs(linguisticallyandexperimentallyjustified) •[GordonandHendricks,1997]:theantecedent’ssyntactic prominence(notionrelatedtotherelativedistanceina syntactictree)influencetheselectionoftheco- referentialcandidate •[GordonandHendricks,1998]:thesalienceofthe relationsbetweennamesandpronounsiscalculatedby usingagraduationofsurfacerealisationpairs:name- pronoun>name-name>pronoun-name 33Component 4: the domain of referential accessibility FilterandorderthecandidateDEs: a Linearly Dorepaal,Mitkov, b Hierarchically Grosz&Sidner;Cristea,Ide&Romary 34 DRA: linear search order 35 DRA: hierarchical search order 36RARE –The engine ForeachREofthetextlevel(lefttoright): •projectionphase •proposing/evokingphase •completionphase •re-evaluationphase Phases of the engine projection phase layer …………………… REatext projection layer … ……… ………… PSa cognitive layer … ………… Phases of the engine proposing/evokingphase layer …………………… REatext projection layer … ……… ………… PSa cognitive layer … DE………… a Phases of the engine proposing/evokingphase layer ………………………… ………………` REbREatext projection layer ………………… ………………… PSb ? layer …………………………………… … DEcognitive a The engine proposes1 text layer ……………………………………………………REaREbREdREx projection layer ………………………………………… psx thresholdmi n cognitive layer ………………………………………………DEmDE1DE0DEmDE1 0 The engine proposes1 text layer ……………………………………………………REaREbREdREx projection layer …………………………………………attrx thresholdmi n cognitive layer ………………………………………………DEmDE1DE0 0 The engine postpones 1 thresholddithresholddi ffff text layer ……………………………………………………REaREbREdREx projection layer ………………………………………… psx thresholdmi n cognitive layer ………………………………………………DEmDE1 0 The engine postpones1 text layer ……………………………………………………REaREbREdRExREy projection layer ………………………………………… psxpsy thresholdmi n cognitive layer ………………………………………………DEmDE1 0 The engine evokes1 thresholddi ff text layer ……………………………………………………REaREbREdREx projection layer ………………………………………… psx thresholdmi n cognitive layer ………………………………………………DEmDE1 0 The engine evokes1 thresholddi ff text layer ……………………………………………………REaREbREdREx projection layer ………………………………………… thresholdmi n cognitive layer ………………………………………………DEmDE1 0 Phases of the engine completionphase layer …………………… REatext projection layer … ……… ………… PSa cognitive layer … DE………… a Phases of the engine completionphase layer …………………… REatext projection layer … ………… cognitive layer … DE………… a Phases of the engine completionphase layer ………………………… ………………` REbREatext projection layer ………………… ………………… PSb layer …………………………………… … DEcognitive a Phases of the engine completionphase layer ………………………… ……………… REbREatext projection layer ………………… ………………… layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… PSbPSc ? layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… PSbPSc layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… PSbPSc layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… PSbPSc layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… PSbPSc layer …………………………………… … DEcognitive a Phases of the engine re-evaluationphase layer ………………………… ………………` REbREaREctext projection layer ………………… ………………… layer …………………………………… … DEcognitive a How can wicked anaphora be accommodated by the framework? Positionallytriggered relations •Nested REs –usually genitival constructions theUniversitybuilding AmenomfistheIVth'swife thefaceofthebeautifulqueen text level levelnesting( )projection levelbelongs-to ( )…cognitive Positionallytriggered relations •Apposition Nefertiti, Amenomfis the IVth's wife text level levelposition=apposition-of( )projection level…cognitive Positionallytriggered relations •The subject-predicative noun relation Mariais the best student of the whole class Your rivalis a photo The young ladybecame a wife text level levelposition=predicative-noun( )projection level…cognitive Positionallytriggered relations •The subject-predicative noun relation Mariais the best student of the whole class Your rivalis a photo The young ladybecame a wife text level levelposition=predicative-noun( )projection levelsame-as(…cognitive ) Lemma disagreement of nouns •Common NPs displaying identical lexical number but different lemmas Nefertiti, Amenomfis the IVth's wife … the beautiful queen text levelNefertitiAmenomfisthe beatiful queen levellemma=queenprojection levelsem=pharaonsimilarity-basedsem=wifecognitive decision Lemma disagreement of nouns •Common NPs with different lexical number and different lemmas A patrol … the soldiers The government… the ministers text levela patrolthe soldiers lemma=soldier projection levelLnum=pl Nnum=pl sem=patrol levelLnum=sgcognitive Nnum=pl Lemma disagreement of nouns •Common nouns referring proper nouns Bucharest… the capital text levelBucharestthe capital projection levellemma=capital sem=capital cognitive level Number disagreement •A plural pronoun identifying a conjunction/ disjunction of singular/plural NPs or a split antecedent John waited for Maria They went for a pizza John waited for Maria He invited her for a pizza Number disagreement John finished his classes He went to a football match As it was a rainy day, no more than 20 people were in the stadium Maria happened to be there too They went for a pizza and one month later got married text levelJohnhis classes20 peopleMariathey projection level JohnMariaclasses20pJohn&Maria levelpersonclasspersongroup-of(personcognitive , ) Example of RARE rules Example of RARE rules Example of RARE rules Example of RARE rules Example of RARE rules RARE in multilingual exercises •Romanian •English •Polish •Greek •Bulgarian •German 72